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The objective of this paper is to identify the 
components of an assessment model that are applicable to the new 
institutions in higher education that are identifying themselves as 
being innovative or nontraditional. The emphasis is on the ne%* 
institutions for several reasons. First, the new institutions are 
under greater pressure to justify their existence and their different 
ways of doing things than are more established institutions; second, 
one of the characteristics of most new institutions is a ccirmitment 
to evaluate and assess; third, while there is a general similarity 
among the new institutions, as a group they are quite different from 
traditional institutions and traditional means of evaluation often do 
not apply. The components of the assessment model through which 
nontraditional institutions are to be evaluated come under the five 
general headings accessibility, flexibility, personalization, 
synthesis, and efficacy of resources. (Author/HS) 
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Evaluating Nonf_-aditional Higher Education — 
A NEW PERSPECTIVE 

The words "innovative" and "nontraditional" are Ibeing bandied about 
lately in much the same manner as accountability and relevance were not so 
• long ago. j 

A rather cursory reading of the literature of hfggher education and 

i 

even of many newspapers and magazines, provides ample evidence thau a great 

/ 

number of colleges and jmiversities are scrambling to be labeled as "innovative* 
or "nontraditional." Indeed, Krebs^ has identified 75 institutions which 
label themselves as "nontraditional," and several new iicstitutions have opened 
with the "nontraditional" label attached at the outset. 

Jlecently, representatives from five of these new "innovative" and 
"nontraditional" institutions met at a conference jointly sponsored by 
Governors Stat University and Educational Testing ServiLce. The Workshop on 
the Assessr^pnt of Nontraditional Higher Education^ was earganized to consider 
ways of assessing the "differences" that nontraditional approaches make upon 
both the educational processes and the students. The general questions 
considered by the participants were: "Do the 'differences' make a difference?" 
And if they do, "How are those differences assessed?" HJhis paper reflects 
concerns expressed by the conference participants. 

American higher education is certainly not withcaut its critics. "Not 
only are criticisms made, but a number of reports from arather prestigious 
organizations and foundations have suggested ways in whiich higher education 
should "put its house in order." Most of the" recommendations made by these 
"critical friends" are considered to be innovative and,, indeed, institutions 



consider themselves to be innovative to the extent to which they adopt 
proposals recommended in these studies and reports. Although the reports 
from the "critics" are not identical, they are amazingly similar in what 
they recommend. And while not all schools have adopted Innovative practices 
. simply because they were recommended by prestigious study groups, it is 
again Interesting that almost all of the "innovations" have been recommended 
Ir one or more of the various reports. It has been suggested that there is 
already developing a "tradition of nontraditional higher education." 

However, the point is not simply that many institutions are imple- 
menting the recommendations made by prestigious educational study groups." 
The Justification for any of these. innovations should not be that "Carnegie 
recommended it." Rather, the justification for all that is done in the 
name of innovation should be that the changes and innovations make good 
educational sense— logically and empirically. It is certainly legitimate 
to ask what evidence justifies doing things "differently?" 

The objective of this paper is to identify the components of an 
assessment model that are applicable to the new institutions. The emphasis 
Is on the "new" institutions for several reasons. First, the new institutions 
are under greater pressure to justify their existence and their "different" 
ways of doing things than are more established institutions; second, one of 
the characteristics of most "new" institutions is a commitment to evaluate 
and assess; thi^d, while there is a general similarity among the new insti- 
tutions, as a group they are quite different from traditional institutions 
and traditional means of evaluation often do not apply* 
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3. 

Components of an Assessment Model 

Whether or not a universally useful model will be developed remains 

to be, seen, but a-^ number of significant problem areas exist which must be 

considered. These problem areas can be conveniently classified under five 

general headings: Accessibility, Flexibility, Personalization, Synthesis, 

and Efficacy of Resources. 1 

Accessibi] ity \ 

I 

Are we providing education for those segments of society who normally 
or formerly did not attend college or who were not satisfied in previous 
educational experiences? Are those who are usually considered educationally 
disenfranchised (i.e., minorities, low Income, older, married, and those 
with diversified work and life patterns) attending the new institution? 
What is the retention rate for these groups? 

Most of the new and innovative institutions were created, in part 

at least, to answer criticisms such as the following from the Newman Report: 3 

By long tradition, American colleges and universities 
discriminate against those who are older than "normal 
student age" and those whose established life and work 
patterns make returning to campus difficult if not 
impossible. 

The answ'irs to the problems of '^^educatlonal apartheid," "the need for 
continuing access," and "barriers to entry and re-entry" were to be seen in 
the new, nontraditlonal institutions. As these institutions were created to 
meet the needs of the "noncollege--age population," they must be evaluated 
in terms of serving the needs of this market. Some early evidence suggests 
that innovative Institutions are only providing another alternative to the 
normal college population, and at the same time are not meeting the needs of 



the students for which they were created. Consequently, a factor In an 
evaluation model for nontraditional colleges must be an examination and 
analysis of the extent to which they are serving the needs of the particular 
segment of the population for vhich they were created. 
Flexibility 

Are we providing educational experiences that are flexible in terms 
of tlme > content and process ? Are entrance requirements and admission 
procedures designed to be flexible, thus allowing the educationally disen- 
franchised to enter the programs? Are there flexible attendance procedures — 
Ingress and Egress flexibility?' Is there flexibility provided for designing 
Individual programs related to the individual's educational goals? Are 
there flexible learning delivery systems? 

Jencks and Hiesman, in The Acadenic Revolution > chronicle in explicit 
detail the evolution from academic diversity to academic sameness. Colleges 
and universities, whether or not equipped with resources and competent faculty, 
attempt to ape either the research university model or the liberal arts 
college model. Though success is not frequent, it is the rare institution 
that does not attempt to recruit both students of "high academic promise" and 
faculty who emulate the models of the graduate school professor. That most 
institutions are not successful in their attempts is not really the point. 
That so many institutions of higher education share the same goals is but 
one general indicator of the lack of diversity. 

The Newman Report^ pointed out quite correctly that: "Nearly all 2500 
Institutions have adopted the same mode of teaching and learning. Nearly all 
strive to perform the same generalized educational mission. The traditional 
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sources of differentiation— between public and private, large and small, 
secular and sectarian, male and female— are 'disappearing. Even the differences 
In character of individual institutions are fading." 

It seems important, therefore, that one component of an assessment 
model for nontraditional institutions be concerned with the extent to which 
they provide alternatives to the general patterns. ' 
personalization | 

Are the educational programs, procedures and environment humane? 
Do the advisement procedures provide for close humane and personal inter- 
actions? Are the educational experiences individually satisfying? Are goals 
Individualized and is self-determination of programs to meet these goals 
evident? 

Any number of critics of higher education emphasize the lack of 
"personalization" as a contributing cause of student dissatisfaction. It 
is axiomatic that the new colleges must be more responsive to needs of indivi- 
dual students. In 1970, the Special Committee on Cacxus Tensions ^ identified 
a number of areas that were "troubling the students." Most prominent among 
-these were the indifference and neglect, which students perceived within the 
institution. 

The growing dissatisfaction with the "multiversity" and its accom- 
panying lack of perscnal attention paved the way for the nontraditional 
post-secondary institutions. Additionally, a more diverse student body 
with a wider range of expectations of higher education makes the challenge 
for "personalization" more pressing. 



ERIC 



The new type of student with diverse backgrounds and goals requires 
a new type of educational program with diverse options and objectives. Con 
eequently, one component of an evaluation model for the nontraditional inst 
tutions must come to grips with the problem of "personalization" and 
"Individualization." Evidence must be presented to stow that opportunities 
for development of personalized programs goes beyond college catalogue 
rhetoric. \^ 
Synthesis 

Are we providing a s- ,.tem th?t facilitates a synthesis of related 
educational and life experiences with the individuals" goals? For what 
prior experiences should credit be given? Formal education? Work? Life? 
What does the student really know? Has the student acquired the skills 
necessary to succeed in life? 

What ±s a college degree? Some cynics maintain that it only 
indicates "time served." Certainly there is no single standard, other than 
"time served" or "units achieved," which allows one to Identify the product 
The range of knowledge and abilities among degree holders is tremendous, 
and who would deny that many high school sophomores can outperform many 
- college students in things academic. 

If the degree represents "things learned," then should not credit 
be given for learning regardless of the source of the knowledge? An 
agreement v;ith the past statement introduces operational questions of 
tremendous import and complexity. Granted that knowledge should be recog- 
nized and rewarded, how does one design the criteria for assessing the 
knowledge and then rewarding with the proper amount of credit? How, for 
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example, does one equate 18 years of experience in the ghetto to sociology 
or psychology "credit" for what has been learned? 

The competency-based or contract curricula offered by a number of 
the nontraditional institutions accentuates even more the pressure to 
recognize actual knowledge and abilities. If "credit" for experience/knowledge 
iB granted, then the criteria for awarding the credit must be scrutinized 
very carefully. If experiential "credit" is equal to or superior to "academic 
credit," then this must be shewn empirically. Likewise, the new institutions 
«ust be Willing to admit, if neces.ary. that the assessnent of prior experience 
18 too difficult, too costly, or harmful (for whatever reasons) to the educa- 
tional enterprise. 

Efficacy of Resources ^ 

Are we effectively identifying and utilising resources for accoa- 
pushing our mission and achievia- our goals? Can we provide the same 
quality education for less money? Less time? 

While there is little disagreement concerning the fact that higher 
education is facing a financial crisis, there is considerable disagreement 
over the approaches to meeting this crisis. Traditionally, university 
administrators have turned mainly to the receipt of additional funds as the 
eolution to these problems. And traditionally they have received these 
additional funds. 

Recently, however, relevant publics are demanding more efficient 
allocation of currently available resources to meet this crisis. "Mere 
Efficient Use of Resources" is the them.e of numerous reports demanding reform 
ixi higher education. In the Report on Hichor F.1u..^...5 y,,^^ -^^^^^^ ^^^^^^^ 
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an entire chapter to what he termed "The Illegitimacy of Lost Effectiveness." 
The concluding page of that report is representative of much of the current 
literature: 

We have found that institutions under financial pressure 
often respond only by cutting expenditures in the easiest 
ways, rather than by making choices according to the 
relative merits of academic programs or the most cost- 
effective approaches to teaching. 

It is apparent that with multimillion dollar budgets 
and a growing questioning by the public, higher education 
can no longer afford the luxury of avoiding considera- 
tion of how effectively it uses its resources. How can 
skill in resource utilization become a factor in the 
system of academic rewards? The challenging intellectual 
task of finding more effective learning patterns by better 
utilization of resources must become a legitinate campus 
concern. 

Thus, one component of an evaluation model for the nontraditional 
Institutions must provide information on the extent to which they are 
efficiently utilizing resources, reducing waste, and eliminating obsolete 
practices. 

Some General Considerations 

In dealing with the factors noted above, it becomes evident that the 
traditional efforts and models are not satisfactory for the task. Dressel^ 
has done an adequate job of pointing out problems involved in evaluating 
Junovation in his monograph The New College s. The preface to his collection 
of articles on evaluative efforts. at new colleges offers the following 
indictment: 

In a sense, these new colleges are unfair to the students 
who enter them. Other than some vague description of 
requirements and of experiences, the student has no adequate 



ERIC 



basis for choice of the program, and neither the student 
nor the faculty has any conception of what benefits in the 
way of cognitive and affective growth of significance in 
later life will emerge from the experience* 

Notwithstanding the fact that most traditional institutions are 
subject to the same indictment, the burden of proof is upon the "new" 
colleges* The problem is that what has been considered acceptable in terms 
of evaluating traditioPial higher education in the past, is not app-icable 
or acceptable for evaluation of nontraditional higher education in the 
present* It is critical that researchers develop :ncntraditional techniques. 
Instruments and methodologies tp evaluate nontraditional institutions. 

One promising technique might involve consequences of a nontraditional 
education as well as looking at achievement of objectives* In an essay 
entitled "Thoughts on Evaluation of Higher Education," Pace said, "The first 
requirement for a new model of evaluation is to begin with whe question, 
'What are the consequences? '"^ This proposition is supported by the idea 
that all programs have multiple consequences, many of which are not objec- 
tives or intentions of the programs. Applying this concept to evaluation of 
new colleges implies asking questions and gathering data which go beyond 
determining the extent to which objectives have been attained~we must 
consider consequences as well as objectives. 

In developing and implementing a model such as suggested here, one 
must be aware that the extent to which colleges and universities have caused 
an "impact" on their students remains to be demonstrated. Feldman and 
Neucomb's comprehensive study on the question of impact^ leads one to the 
compromising conclusion that the impact upon students is largely a function 
of student and environmental characteristics that cannot be attributed 
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directly to the college experience. This conclusion raises questions con- 
cerning the wisdon of even attempting to measure the Impact of the new 
colleges. 

Feldnsan ana Neucomb's rather negative finding is further supported 
In the following statement from the r<»cent study by Christopher Jencks and 
Associates'^: 

Findings have convinced us that the long-term effects of 
•schooling are relatively unifona. The day-to-day internal life 
of the schools, in contrast, is highly variable. It follows 
that the primary basis for evaluating a school should be 
whether the students and teachers find it a satisfying place 
to be. 

In light of these findings, it seems that a new evaluation model 
night consider "satisfaction" or "expectancy" indices as one evaluative 
criterion. This would imply that data collection and analyses would be 
a means toward determining the degree to which members of the .various 
university publics are satisfied with the "innov.itive" institution and/or 
the extent to which it has met their expectations. Even if all else fails, 
a model that considers tie establishment of criteria of "satisfaction", or 
"expectancy" would have some basis for measuring the "impact" of the new ' 
Institution. 

In any eve-it, the "honeymoon" for the new institutions will soon be 
over. If new evaluative criteria and techniques are not developed and refined. 
Judgment will be made according to the traditional criteria. Regardless of 
whether the innovations flourish or die on this basis remains to be seen. One 
thing will be certain, however, and that is~they were not propeily evaluated. 

It seems the -final decision regarding the "inpact" of higher 
education remains a moot point. But one thing does r«fflain clear. The "new" 
Institutions do have different goals and it is not totally appropriate that 
they he evaluated in terms of criteria designed for institutions with other 
goals. 
ItI111572 
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